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Method, System and User Terminal for Collecting Information 
on Audience of Broadcast Media Stream 

Field 

The invention relates to a method, a system and a user terminal for 
5 collecting information on the audience of a broadcast media stream. 

Background 

Many broadcasters are interested in monitoring their audience for 
several reasons. Especially commercial radio or television broadcasters need 
customer information for improving their business; the more they have listeners 

10 the more tempting they are from an advertiser's point of view. Advertisers also 
need information on their campaigns: how many customers listened to an ad- 
vertisement, whether they liked it or not, how well the product sold, etc. 

In the prior art there are several research methods for collecting in- 
formation on audience. Some widely used methods are questionnaires or fo- 

15 cus group interviews. These methods are quite slow and they cannot be used 
in online adaptation of the broadcast. Additionally, questionnaires or group in- 
terviews are directed to a selected audience group, the size of which is limited. 
Therefore the reliability of the results depends strongly on advance planning 
and the size of the group, since the size of the group has to be quite significant 

20 in order that the result is reliable, the expenses rise correspondingly. 

Especially, the prior art methods are not rapid enough in monitoring 
the audience of interactive programs which nowadays are becoming more and 
more popular. 

Brief description of the invention 

25 An object of the invention is to provide an improved method for col- 

lecting information on an audience of a broadcast media stream. The method 
comprising: connecting a radio telecommunication system and a broadcast 
system to perform a media system, broadcasting a media stream on at least 
one broadcast channel of the broadcast system, transmitting parallel informa- 

30 tion on at least one parallel channel which parallel information is associated 
and synchronized with the media stream of at least one broadcast channel, 
connecting the audience to the media system as passive users or active users, 
the active users receiving the parallel information and the passive users not 
receiving the parallel information, collecting information on the audience con- 
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nected to the media system, the information being on active users and/or pas- 
sive users, processing the collected information in a predetermined way. 

According to an aspect of the invention, there is provided a media 
system for collecting information on the audience of a broadcast media stream, 

5 comprising: means for broadcasting a media stream on at least one broadcast 
channel of the broadcast system, the broadcast system being part of the media 
system, transmitting parallel information on at least one parallel channel which 
parallel information is associated and synchronized with the media stream of at 
least one broadcasting channel using a radio telecommunication system of the 

10 media system, means for connecting the audience to the media system as 
passive users or active users, the active users receiving the parallel informa- 
tion and the passive users not receiving the parallel information, means for 
collecting information on the audience connected to the media system, the in- 
formation relating to active users and/or passive users, means for processing 

15 the collected information in a predetermined way. 

According to another aspect of the invention, there is provided a 
user terminal for collecting information on an audience of a media stream 
broadcast by a media system comprising: means for receiving parallel informa- 
tion on at least one parallel channel which parallel information is associated 

20 and synchronized with the media stream of at least one broadcast channel of 
the broadcast system, the broadcast system being a part of the media system, 
means for connecting the audience to the media system as passive users or 
active users, the active users receiving the parallel information and the passive 
users not receiving the parallel information, means for changing a parallel in- 

25 formation reception state according to the user's selections, means for trans- 
mitting selections made by active users for collecting information on the audi- 
ence connected to the media system, means for showing the collected infor- 
mation. 

Further embodiments of the invention are described in the depend- 

30 ent claims. 

The method and system of the invention provide several advan- 
tages. According to an embodiment of the invention, the radio station is able to 
observe the development of an on-line audience almost real time, obtain view- 
able statistical information on the audience and arrange interactive polls, com- 
35 petitions, etc. 
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List of drawings 

In the following, the invention will be described in greater detail with 
reference to the preferred embodiments and the accompanying drawings, in 
which 

5 Figure 1 shows an example of a wireless telecommunication sys- 

tem, 

Figure 2 is an example of a media system, 
Figure 3 is a flow chart, 

Figures 4A-C show an example of a broadcast system, a server and 
10 a content creation tool, 

Figure 5 shows an example of a user terminal. 

Description of embodiments 

Referring to Figure 1, a block diagram illustrates an example of a 
wireless telecommunication system. The wireless telecommunication system 
15 may be based on, for example, UMTS (Universal Mobile Telephone System) or 
WCDMA (Wideband Code Division Multiple Access). 

The core network may correspond to a combined structure of the 
GSM (Global System for Mobile Communications) and GPRS systems (Gen- 
eral Packet Radio Sen/ice), for example. The GSM network elements are re- 
20 sponsible for the implementation of circuit-switched connections, and the 
GPRS network elements for the implementation of packet-switched connec- 
tions, some of the network elements, however, being shared by both systems. 

A centre 100 represents a mobile services switching centre (MSC) 
and a serving GPRS support node (SGSN) enabling circuit-switched and 
25 packet switched signalling, respectively, in the radio system. 

The core network may have a gateway unit 102, which represents a 
gateway mobile service switching centre (GMSC) and a gateway GPRS sup- 
port node. The GMSC attends to the circuit-switched connections between the 
core network and external networks, such as a public land mobile network 
30 (PLMN) or a public switched telephone network (PSTN), and the GGSN at- 
tends to the packet-switched connections between the core network and ex- 
ternal networks such as the Internet. 

The centre 100 controls a radio access network (RAN) 104, which 
may comprise at least one base station controller 106 controlling at least one 
35 base station 108. The base station controller 106 may also be called a radio 
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network controller and the base station may be called a node B. A subscriber 
terminal 110 communicates with at least one base station 108 over a radio in- 
terface. 

The radio server 112, which is an important part of the present solu- 

5 tion, may be connected to the centre 100, but it may also be connected to the 
gateway 102 or to some part of the RAN 104. In some applications, the radio 
server 112 may communicate with the radio system over a radio interface in 
the same manner as the subscriber terminal 110. 

Telecommunication systems are explained in further detail in the 

10 standards and literature of the field. 

Figure 2 shows an example of an embodiment of how a wireless 
telecommunication system and a broadcasting system are connected together 
for performing a media system for transmitting parallel information related to a 
broadcast media stream, such as a radio program. Regarding the parallel 

15 channel, the media system may comprise the following elements: a broadcast 
system 200, a content creation tool 202, a server 112, the network 104 of a 
wireless telecommunication system and the subscriber terminal 110. The 
broadcast system 200 of a broadcast station uses a digital content manage- 
ment system to run a broadcast, such as an FM transmission, an AM trans- 

20 mission or a digital radio or television transmission. The broadcast system 200 
broadcasts TV or radio programs. 

The content creation tool 202, which may also be called a visual ra- 
dio tool, is used to create parallel channel content presentation to be displayed 
on subscriber terminals. The content creation tool 202 typically locates in the 

25 radio or television station and it may be integrated into the broadcast system 
200. 

The server 112 provides the users with the content related to the 
broadcast based on their current parallel channel selection. The server 112 
controls the content flow to and from the subscriber terminals. It facilitates a 

30 timed delivery of the content to the subscriber terminal, as well as the collect- 
ing and forwarding of interaction results to the radio station. The server con- 
trols the number of users. If necessary, the server limits the number of users 
using the parallel channel at the same time. The server also takes care of con- 
tent adaptation for different application platforms in various subscriber termi- 

35 nals. 
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A radio access network (RAN) 104 provides the connection to the 
subscriber terminals via a wireless telecommunication network. The sub- 
scriber terminal may be a mobile phone, a palm computer or a laptop, for in- 
stance. The details of the radio access network and subscriber terminals may 

5 vary according to the manufacturer and the used wireless telecommunication 
standard applied. 

Figure 3 is a flow chart depicting a preferred embodiment of a 
method for collecting information on the audience of a broadcast media 
stream. An embodiment of the method uses a visual radio application in the 

10 subscriber terminal, a visual radio server and a content creation tool, which will 
be discussed later in this application. The method is suitable for obtaining in- 
formation on the audience of a radio or TV program for example to poll audi- 
ence opinions in relation to a broadcast (programs or advertisements), to cre- 
ate interactive advertising and other interactive events, such as voting and 

15 quizzes, or to keep record of the number of the audience in general. The radio 
station is able to observe the development of an on-line audience almost real 
time, obtain statistical information on the audience and arrange interactive 
polls, competitions, etc. 

The method begins in block 300. In block 302 a telecommunication 

20 system and a broadcasting system are connected together for performing a 
media system for transmitting parallel information related to a broadcast media 
stream. The media system is depicted in more detail in Figures 2 and 4A-C. 
The parallel information (also called the parallel channel content) typically com- 
prises one or more parallel information objects (text strings, graphic file ob- 

25 jects, animations, video clips, etc) and instructions for displaying the objects 
(positions of objects, timing, etc.). 

In block 304 a media stream is broadcast on at least one broadcast 
channel of the broadcast system. Nowadays, the broadcast system of a broad- 
cast station typically uses a digital content management system to run a broad- 

30 cast, such as an FM transmission, an AM transmission, or a digital radio or 
television transmission. Programs including advertisements and breaks for ad 
hoc presentations are stored beforehand and the digital content management 
system runs the programs under the control of an editor. 

In block 306 parallel information which is associated and synchro- 

35 nized with the media stream of at least one broadcast channel is transmitted 
using the media system. The parallel information is transmitted on a parallel 
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channel. There may also be several parallel channels. The process regarding 
the creating and transmitting of the parallel information will be discussed in 
further detail later in this application. Briefly, the parallel information is created 
using the broadcast system, the content creation tool and the visual radio 
server and then sent to the user via a radio telecommunication network. The 
parallel information is usually transmitted as a packet transmission. 

In block 308 the audience is connected to the media system either 
as passive users or active users, the active users receiving the parallel infor- 
mation and the passive users not receiving the parallel information. In other 
words, the term active refers to users who are actively receiving the content 
updates delivered by the radio server, i.e. these users are in a flow mode. Pas- 
sive users are users who are not receiving the content updates, and may or 
may not be using the service at a particular moment. The audience has pref- 
erably an interactive connection to the media stream system via an interactive 
menu shown on the screen of their user terminals. The users who have the 
terminal application running, and are viewing the (delivered parallel channel) 
content on the screen are active users. The users who have the application 
running but do not receive the content are passive. A user might not receive 
/see the content due to multiple reasons: the application is minimized or run in 
a background, another application is running on the screen foreground and 
application has no display screen, screen saver is on, the application is run- 
ning but a user is doing something else which prevents him seeing the parallel 
channel (i.e. browsing some other content). The application should report 
changes in the state to the server. 

In block 310 information on the audience connected to the media 
system is collected. This is done by using the parallel channel as a feedback 
channel. If the system comprises several parallel channels, it is possible to use 
one channel as a forward channel and another as a feedback channel, for in- 
stance. The information may relate to active users and/or passive users. The 
state of parallel information reception (active or passive) of a user terminal is 
reported to the server to provide on-line information on the number of active 
and/or passive users. The server collects the information and maintains a da- 
tabase of the statistics. In addition, the information may relate to polling audi- 
ence opinions in relation to broadcasts (programs or advertisements). Informa- 
tion may be collected from advertising, votes and quizzes, etc. For interactive 
advertising, the number of responses received from the audience is collected. 
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The templates for the screen menu of a subscriber terminal may be 
ready-made, in which case they are stored in a user terminal and modified ac- 
cording to the parallel information. The templates may also be transmitted as 
parallel information. 

5 In an embodiment of the method, the subscriber terminal reports to 

the radio server when the application mode, that is the parallel information re- 
ception state, changes. Only users in the flow mode (active users) are as- 
sumed to be able to view the current content, whereas other (passive users) 
may be listening to the broadcast but are not actively following the information 

10 on the parallel channel. When a user is in the flow mode, content delivered 
from the server is updated automatically on the terminal screen according to 
the timing definition. The application may be switched to the background or to 
the initiating communication off-mode or a screen saver may be turned on, pre- 
venting the user from viewing the current content updates. These users are 

15 called passive users. 

The events to be reported to the server are, for instance: an applica- 
tion start, i.e. a currently selected radio station is reported to the server, an ap- 
plication end, i.e. a pause in the reception of a parallel channel and or a 
change of a mode of the application is reported (for instance from a pause 

20 state to a resume state), and an application poll, i.e. a response to a query 
sent by the server is reported. The server may also update its information peri- 
odically. 

The visual radio application may be instructed to send a response to 
the server when the user starts an interactive connection by a pressing a vir- 
25 tual button on the screen. The response to be sent is defined separately for 
each button on the screen by the content creation tool. The timing of the 
chances in the general appearance of the screen may be defined to match a 
particular event in the broadcast, such as a song, an advertisement or a com- 
petition. 

30 The subscriber terminal may have an identifier that is sent to the 

server with an event report. This dentifier may be a terminal-specific identifier 
or derived from one, e.g. IMS I or MSISDN, or created by the server as a re- 
sponse to a terminal request and stored by the terminal between sessions 
(similar to the cookie mechanism in the Internet). This makes it possible to ob- 

35 tain information on a particular subscriber terminal. An interactive event, such 



WO 03/090482 



PCT/F103/00288 



8 

as a quiz, may also have an identifier that enables connecting answers to the 
corresponding interactive event and performing statistics. 

In block 312 the collected information is processed in a predeter- 
mined way, for example statistically, The information may also be shown on 

5 the screen of a user terminal or a broadcaster's terminal. Templates for show- 
ing the collected information may be made and stored in a terminal in advance. 
The ready-made templates can be modified according to the parallel informa- 
tion. If the templates do not require too much transmission capacity, they can 
also be transmitted entirely as a parallel information. 

10 In an embodiment, the server maintains a database for subscriber 

terminal event reports and uses the database to create graphics of statistical 
information, which are shown in a subscriber terminal using a content creation 
tool. The graphics may be automatically updated when new information be- 
comes available or created as a response to a query. Many kinds of informa- 

15 tion views may be shown on the basis of events reported from subscriber ter- 
minals: the number of current users, current active users and current passive 
users. The number of current users is increased when an application start- 
message is reported and decreased when an application end -message is re- 
ported. The number of current active users is increased when an application 

20 start or an application resume -message is reported and decreased when an 
application pause or an application end -message is reported. The number of 
current passive users is increased when an application pause is reported and 
decreased when an application resume is reported. It should be noticed that 
application polling and periodic reporting can be used to refresh the numbers 

25 at any time. 

When it comes to the interactive advertising, the number of re- 
sponses received from the audience is collected. When an interactive screen 
containing different options is delivered to subscriber terminals, graphics 
and/or other corresponding information (options, images, etc.) are initialised. 

30 Each time an interactive response is reported from a subscriber terminal as a 
selection preformed by the user, the number of the option is increased in the 
database of the server. The share of the audience participating in the action in 
question can be given as a percentage of selected options compared with the 
number of active users, for instance. The information in the database of the 

35 server can be saved for later use to enable long-term analysis of the data. 
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A couple of examples of utilising the information gathered form the 
audience are: the collected information may be used for searching for good 
hours, geographical areas and/or modes for advertising; the best time to ad- 
vertise is, of course, the time when the amount of the audience is biggest The 
5 type of the audience is also important and this is why the user profiles are im- 
portant. The geographical areas are interesting, when the advertiser wants to 
aim his advertising to a particular area, its neighbourhood, for instance. It is 
also possible to improve the mode of advertising by using polls. 

Because each event reported from a subscriber terminal contains 
10 an identifier, it is possible to use the database for a statistical analysis. One 
example is the forming of listening profiles, for example the number of times a 
user returns to the station during a predetermined period of time. 

If the user identifier is compared to demographic statistics or other 
comparable information on the user, the database can also be used for more 
1 5 specific analysis of user groups and segments in real time. 

The method ends in block 314. An arrow 316 depicts one possibility 
for repeating the method. 

It should be noticed that it is possible to collect location information 
on the audience. For this purpose, a user terminal may send information on its 
20 location or there may be a separate database comprising location information. 
By using location information it is possible to observe the amount of audience 
in a particular location. 

Next, an example of an embodiment of the method for collecting in- 
formation on the audience of a broadcast media stream is discussed. Although 
25 this embodiment is described with reference to a radio broadcast systems. The 
invention can be applied to other broadcast systems as well. 

The transmitting of parallel information associated and synchronized 
with the media stream of at least one broadcasting channel comprises two 
main phases: creating parallel information and transmitting it. 
30 The parallel information is created as follows: a radio station creates 

a parallel information definition message by using the content creation tool 
202. The creating of the parallel information definition message requires infor- 
mation such as user options, a displayed prompt text, a screen layout, a paral- 
lel information identifier and timing information. The content creation tool 202 
35 sends the parallel information definition message to the server 112. The server 
112 searches for a corresponding parallel information object in the database. 
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The server 112 transmits the parallel information object usually as a packet 
transmission to the connected terminals 110. The parallel information object is 
saved in the memory of a subscriber terminal 110 for later use, or it is shown 
immediately. The server 112 may modify the parallel information object by de- 
5 fining terminal-specific parameters, such as virtual button sizes and positioning 
on the screen of the subscriber terminal and/or graphics according to the re- 
quirement of the subscriber terminal in question. The parallel information is 
shown on the screen of the subscriber terminal in synchronization with the 
broadcast. 

10 Information on active users is collected as follows: a user answers 

to a poll, quiz or the like, by selecting an option shown on the screen by press- 
ing a virtual button. The answer, and together with it, the user identification 
and/or the parallel information identifier are communicated to the server 1 12. 

The information can be processed in several ways. For example, 

15 the server 112 aggregates the number of the answers corresponding to the 
answer in question. 

The content creation tool periodically inquiries the server to get up- 
dated statistics. The updated statistics are read from the database of the 
server 112 and sent to the content creation tool 202 which updates its display 

20 in such a way that the current situation can be seen. The content creation tool 
202 is in this example the terminal of the broadcaster. 

Figures 4A-B depict more details of the broadcast system, the 
server and the content creation tool. The shown functional structures are ex- 
amples and it is obvious for a person skilled in the art that the broadcast sys- 

25 tern, the server and the content creation tool can be implemented in several 
ways. 

The broadcast system is shown in Figure 4A. The broadcast system 
200 comprises a timing information module 404, a dynamic content delivery 
module 402 and a user interface 406. Timing information is used to synchro- 

30 nize transmissions of the broadcast channel and the parallel channel. It is 
communicated to the server 112 by the timing information module 404. The 
timing information module 404 provides information on the starting time and 
ending time of a particular program, as well as the timing of advertising breaks 
etc. The length of broadcast advertisements and similar breaks can be de- 

35 duced, for example, from the show's run time at the starting time of the break. 
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The dynamic content delivery module 402 can feed additional con- 
tent information to a content structure tool 416 and a content packaging mod- 
ule 414 included in the content creation tool 202 and, finally, to a content de- 
livery engine 410 in the server 112. The additional content information from the 

5 dynamic content delivery module 402 can be, for example, results of events 
arranged in the broadcast, such as the name of a winner in a quiz show. When 
the additional content information is determined during the program, for exam- 
ple, during live events, a sports coverage or in a broadcast radio, the additional 
content information is communicated to the content packaging module 414 in 

10 the content creation tool to dynamically create additional content items of the 
parallel information. 

In addition, the dynamic content delivery engine module 402 may 
receive interaction results from an interaction engine 412 located in the server 
112 through a feedback module 418 in the content creation tool 202 and to be 

15 used as a part of the broadcast, for example to display the results of a vote on 
the TV as a video overlay. 

A user interface 406 controls and adjusts by the broadcasting per- 
sonnel the parallel channel timing with respect to the broadcast media stream. 
For example, signalling in the parallel channel may be paused and resumed to 

20 stop and resume the playing of the parallel channel. These control events are 
communicated through a synchronization engine 408 located in the server 112 
to the subscriber terminal 110, which then adjusts parallel channel timing ac- 
cordingly. 

The broadcast content delivery module 400 supplies the broadcast 
25 to a broadcast receiver, such as an FM radio receiver, a TV set, or the like. 
The receiver may be situated in the subscriber terminal. 

The feedback module 418 of the content creation tool 202, the in- 
teraction engine 412 and the memory 420 of the server 112 process the inter- 
action results and create a suitable presentation to be shown to the broadcast- 
30 ing personnel or to the receivers of the broadcast. 

The server is shown in Figure 4B. The server 112 provides the us- 
ers with content related to the broadcast based on their current parallel chan- 
nel selection. The server controls the flow of the parallel information content to 
and from the subscriber terminal. It facilitates the synchronized delivery of con- 
35 tent to the subscriber terminal as well as the collecting and forwarding of inter- 
action results to the radio station. The server controls the number of users. If 
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necessary, the server limits the number of users using the parallel channel at 
the same time. The server also takes care of content adaptation for different 
application platforms in various subscriber terminals. 

To enable statistics on both currently active and passive users to be 

5 complied, the subscriber terminal 110 reports to the server 112 when the ap- 
plication mode, that is the parallel information reception state, changes. Only 
users in a flow mode (active users) are assumed to be able to view the current 
content, whereas other (passive users) may be listening to the broadcast but 
are not actively observing the parallel channel. When a user is in the flow 

10 mode, content delivered from the server is updated automatically on the termi- 
nal screen according to the timing definition. The application may be switched 
to the background, to the initiating communication off-mode or a screen saver 
may be activated, preventing the user from viewing the current content up- 
dates of the parallel information. 

15 The synchronization engine 408 receives the starting time and the 

advertising break information from the timing information module 404 of the 
broadcast system 200. In addition, the synchronization engine 408 provides 
the means for subscriber terminals to synchronize their clocks with broadcast 
system time references by running a synchronization algorithm with the server. 

20 The content delivery engine 410 delivers a signal with the content 

package created by the content packaging module 414 of the content creation 
tool to the content delivery engine 410 in the server. The signal is fed from the 
content delivery engine 410 to the interaction engine 412 in the server which 
sends the signal through the network 104 to the subscriber terminal 110 as 

25 parallel information. A subscriber-terminal-specific variant of the content can 
be delivered, which contains graphics objects optimised to the capabilities and 
the screen size of each subscriber terminal. A content package, including ob- 
ject identifications or other content items, may correspond to an entire program 
and be delivered before the program starts. The content can alternatively be 

30 delivered in a single package that contains both the subscriber terminal soft- 
ware module in a suitable format, such as a Java MIDIet and the content pack- 
age for a particular show. This is suitable for recorded shows and programs, 
where the content and content timeline are known beforehand. In that case, 
dynamic content can be delivered in addition to the content package to take 

35 care of variation in the content during the broadcast. 



WO 03/090482 



PCT/FI03/00288 



13 

Alternatively, the content can be delivered dynamically in content 
blocks, one block corresponding to a segment of a program. This approach is 
suitable for FM radio for example, where several songs to be played and dif- 
ferent kinds of breaks such as advertising breaks are usually decided in ad- 
5 vance. 

If a user answers to a poll, for instance by selecting an option shown 
on the screen by pressing the virtual button in question, the user identification 
and/or the parallel information identifier are communicated together with the 
answer to the interaction engine 412 of the server. The server aggregates 

10 number of the answers relating to the poll. Therefore, the server also com- 
prises a memory 420, where identifiers and answers are stored. A memory 
record may be composed of a parallel information identifier, typically a number, 
for associating answers with the corresponding poll, advertisement etc, and the 
number of selections of each option, for example, and/or the memory record 

15 may be composed of a user identifier for forming a user profile. 

The content creation tool 202 may periodically request the server 
112 to give updated statistics. The updated statistics are read from the data- 
base and sent to the content creation tool 202, which updates its display in 
such a way that the current situation can be seen by a broadcaster. 

20 If the responses are in text format, the radio server saves the re- 

sponses in text format. The content creation tool then receives the responses 
in the text format and they are shown on the display as such. 

The server 112 maintains a database in a memory 420 for sub- 
scriber terminal event reports and uses the database to create graphics of sta- 

25 tistical information, which are shown on a subscriber terminal (or on a broad- 
caster's terminal using a content creation tool 202). The graphics can be up- 
dated tained automatically when new information becomes available or created 
in response to a query. 

Because each event reported from a subscriber terminal contains 

30 an identifier, it is possible to use the database for analysing of user profiles, for 
example the number of times the user returns to the station during a predeter- 
mined period of time. 

If the user identifier is compared to demographic statistics or other 
comparable information on the user, the database can also be used for a more 

35 specific analysis of user groups and segments in real time. 
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The content creation tool is shown in Figure 4C. The content crea- 
tion tool 202, which may also be called a visual radio tool in many applications, 
is used to create the parallel channel content (or a parallel information object) 
presentation to be displayed on the subscriber terminal. The content creation 
tool can be used to poll audience opinions relating to broadcasts (programs or 
advertisements), to create interactive advertising and other interactions, such 
as votes and quizzes. The content creation tool is also used to monitor the 
compiled statistics on the server and to create or modify the outer appearance 
of the display of a subscriber terminal. It is also used to create the content of 
the parallel channel for collecting user responses. The parallel channel acts as 
a feedback channel for user responses sent back from subscriber terminals. 

The content creation tool is typically located in the radio or television 
station and the content creation tool may be integrated into the broadcast sys- 
tem 200. A content structure tool 416 creates timing for displaying parallel 
channel content associated with a broadcast media stream in time (for exam- 
ple, to show this parallel channel object on the screen of the subscriber termi- 
nal at 14:43:02 after the beginning of the program). Responses that are sent to 
the server 1 12 in response to the user interaction can be fed to the feedback 
module 418 located in the content creation tool. 

The content structure tool 416 defines the layouts for displaying the 
parallel information objects, such as the sizes and positions of the objects on 
the screen of the subscriber terminal. 

The content packaging module 414 is used to create a content 
package i.e. the format in which the parallel information is delivered to the sub- 
scriber terminal 110, including instructions for displaying the information (posi- 
tions of objects, timing, etc.), as well as the content to be displayed, which 
usually consist of one or more parallel information objects (text strings, graphic 
file objects, animations, video clips, etc). 

Generally, the content creation tool allows the radio station to create 
a visual presentation and manage the content flow shown on the screen of the 
subscriber terminal in synchronization with the broadcast. In addition, the con- 
tent creation tool allows the station to manage interactive elements, such as 
delivery and purchase of objects, votings and quizzes. 

Additionally, it is possible to utilise location information on the audi- 
ence. This is typically done by compiling location information in the server 
which then communicates the information to the content creation tool. The con- 
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tent creation tool visualises by using a map the amount of the audience in a 
particular area, for instance. The information can be used for profiling the audi- 
ence, designing advertising, for instance. The user terminal may send informa- 
tion on its location or there may be a separate database comprising location 

5 information. Typically, it is not required to follow a particular audience member 
but to see the amount of audience in a determined area. 

Figure 5 shows a simplified example of a subscriber terminal 
whereto the embodiment of the invention can be applied. The terminal may be 
a mobile telephone or a microcomputer, for example, without being restricted 

10 thereto. 

In the subscriber terminal, the media system provides an integrated 
user experience, allowing the user to start both listening to a broadcast and 
receiving the content relating to the broadcast on the parallel channel. The op- 
eration of the media system is based on two channels, the broadcast channel 

15 and the parallel channel. The media system, on the other hand, provides a vis- 
ual and interactive parallel channel functionality, such as receiving and display- 
ing content objects and reporting user interactions to a server. 

The terminal comprises an antenna 500 with which signals are both 
transmitted and received via a duplex filter. A terminal may also comprise a 

20 broadcast receiver 518 such as a TV or a radio tuner, a video streaming en- 
gine, etc. for receiving for example radio or TV programs, with which case 
there is a need for a broadcast receiver antenna. These antennas may be in- 
tegrated or separate antennas. 

The terminal further comprises a transmitter for a wireless telecom- 

25 munication system 502, to amplify and transmit a modulated signal to the an- 
tenna, a modulator 504 modulating the carrier wave by a data signal compris- 
ing the desired information in accordance with a selected modulation method, 
a receiver 506 which amplifies the signal supplied from the antenna and down- 
converts the signal to a selected intermediate frequency or directly to base- 

30 band, and a demodulator 508 demodulating the received signal to enable a 
data signal to be separated from the carrier wave. 

The subscriber terminal also comprises a controller block 516 com- 
prising, for example, control and calculation means for controlling the operation 
of the different parts of the terminal, means for processing the speech of the 

35 user or the data generated by the user, such as a digital signal processing 
(DSP) processor comprising, for example, channel correction functions com- 
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pensating for interference in the signal caused by the radio channel by utilising 
information on the channel obtained from a known training sequence, A/D con- 
verters converting an analogue signal into a digital one by sampling and quan- 
tizing the baseband signal, D/A converters converting a digital signal to an 

5 analogue one by a reverse method, filters at the receiver which filter frequen- 
cies outside a desired frequency band or, which in band-restricted systems 
restrict the band width of the output at the transmitter, and coding and decod- 
ing means for both channel and speech coding. 

Furthermore, in spread-spectrum systems, such as WCDMA, the 

10 spectrum of the signal is spread at the transmitter by means of a pseudo- 
random spreading code over a wide band and despread at the receiver, in an 
attempt to increase channel capacity. The control block also comprises means 
for arranging the signal to be transmitted and the signalling information to con- 
form to the air interface standard of the cellular radio system used. 

15 The user interface of the terminal comprises a loudspeaker or an 

earpiece 510, a microphone 512, a display 520 and possibly a keypad and/or a 
joystick or a similar device. The user interface devices communicate with the 
control block. 

The terminal also comprises several different memory elements that 

20 are shown as one functional block 514. The parallel information delivered to 
the subscriber terminal from the server interaction engine 412 may be stored in 
the local memory 514. 

The content structures (the layouts and other display instructions for 
displaying the parallel information objects typically performed on a slide basis, 

25 where the slide means one screen of information in the subscriber terminal) 
are separated from the parallel information and saved to the content structure 
memory 834. The content structure also comprises possible templates. The 
content objects (for example, texts and figures to be shown on the screen), in 
other words the parallel information objects are also separated and saved to 

30 the content object memory 532. The separation and saving can be performed 
as a background process, whereby the required information is always available 
to a content processor 522 and a rendering engine 524 when needed. The 
rendering engine 524 forms visual and acoustic effects. Default information 
can also be stored in the local memory to be shown in case dynamic content 

35 cannot be delivered to the subscriber terminal in time. 
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The initiation of the parallel channel can be made in several ways. 
The user can select an operation which causes the subscriber terminal to re- 
ceive and display the information from the parallel channel. If the subscriber 
terminal includes a receiver for the broadcast channel, the user can select a 
5 suitable broadcast channel and the subscriber terminal may automatically initi- 
ate the reception and display of the parallel channel, instead of manual initia- 
tion. 

When a parallel channel software operation is initiated in the sub- 
scriber terminal, he subscriber terminal may transmit information about itself to 

10 the server 112 and the server informs the subscriber terminal of the media 
stream. With the information on the subscriber terminal, a specific variant of 
the content can be delivered, which contains graphics objects optimised to the 
capabilities and the screen size of each subscriber terminal. 

A timer controller module 528 establishes a connection to the 

15 server. The timer controller module 528 runs a synchronization algorithm to 
synchronize an internal clock of the subscriber terminal with the time in the 
server. A simple synchronization algorithm can be used, based on calculating 
round trip delays of requests sent to the server from the subscriber terminal 
and calculating the difference between the subscriber terminal clock and the 

20 server clock. Once the subscriber terminal has performed the synchronization 
and the starting time of a program is known, media stream timeline references 
can be translated to corresponding of references in the internal clock of the 
subscriber terminal. The parallel information can be shown to the user in syn- 
chronization with the broadcast. 

25 The timer controller 528 determines whether the program has al- 

ready started and what is the current timeline position. If the program is run- 
ning, the timer controller 528 can automatically find the correct content item in 
the parallel channel to be displayed in the display of the subscriber terminal. 

Once the software of the subscriber terminal is activated and the 

30 subscriber terminal has received parallel information to be shown, the content 
processor 522 starts executing. The processor reads the content structure in 
the content structure memory 534 for determining the current content to be 
displayed and communicates the content structure to the rendering engine 
524. Based on the content structure, the content processor 522 informs the 

35 timer controller 528 to trigger proceeding in the parallel channel according to 
the content structure. Then the content processor 522 is initiated again to dis- 
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play the next parallel information object (content item). The processor 522 
reads another content structure in the content structure memory 532, deter- 
mines the next parallel information object and possible layouts and sends them 
to the display 520. 

5 The subscriber terminal sends an action report message to the 

server, when a change in the parallel information channel state is triggered or 
a user answers to a poll, etc. The events to be reported to the radio server are, 
for instance: an application start (active state), i.e. a currently selected radio 
station is reported to the server, an application end, i.e. an application pause is 

10 reported when the mode of application changes (active/passive), an applica- 
tion poll, i.e. a response to a query sent by the server is reported and a peri- 
odic reporting. 

A signal having information on the action is communicated to the 
content processor 522. The action may be a report on a change in the parallel 

15 information reception state or on a user activity such as an answer to a quiz, 
for example. The content processor then analyses the action and triggers a 
transaction as defined by the content structure of the action. The user activity 
automatically triggers communication from the subscriber terminal 110 to the 
server 112 and thus the user does not need to know a long list of service num- 

20 bers, sen/ice codes or identification strings. The signal of the user action is 
communicated from the content processor to the interaction engine 526 of the 
subscriber terminal, which transmits the signal through the network to the in- 
teraction engine 412 of the server using the parallel channel as a feedback 
channel. 

25 A subscriber terminal may have an identifier that is sent to the 

server with an event report. This identifier can be a terminal-specific identifier 
or derived from one, e.g. IMSI or MSISDN, or created by the server in re- 
sponse to a terminal request and stored by the terminal between sessions 
(similar to the cookie mechanism in the Internet). This makes it possible to ob- 

30 tain information on a particular subscriber terminal. An interactive event, such 
as a quiz, may also have an identifier that enables connecting answers to the 
corresponding interactive event and compiling statistics. 

Blocks 522, 524, 526 and 528 required for the parallel channel com- 
munication may be situated in a specific software module. This module can be 

35 implemented using an operating system, such as Symbian, or a programming 
environment, such as Java MIDP. 
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After the parallel channel software module in the terminal is initiated, 
the module is informed of the broadcast and/or the program the user is inter- 
ested to follow. The user can also make the selection by using another termi- 
nal software module, such as a program guide delivered to the terminal over a 
5 browser interface. 

Even though the invention is described above with reference to an 
example according to the accompanying drawings, it is clear that the invention 
is not restricted thereto but it can be modified in several ways within the scope 
of the appended claims. 
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